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FOREWORD 


This  research  was  performed  under  Exploratory  Development  Task  Area 
PF55.522.004  (Exploring  New  Technologies  for  Designing  Navy  Training 
Courses)  and  Work  Unit  Number  PF55.522.004.01.58  (Innovative  Uses  of 
Feedback  to  Kaxlmlze  the  Transfer  of  Perceptual  and  Perceptual-Motor 
Training) . The  research  was  Initiated  in  response  to  requests  from  the 
Chief  of  Naval  Technical  Training  and  the  Service  School  Command,  San  Diego, 
to  develop  iBq;>roved  training  methods  for  welders.  Earlier  efforts  toward 
this  end  can  be  found  in:  (1)  NPTRL  SRR  72-61,  Development  and  Evaluation 

of  Experimental  Arc  Welding  Training  Procedures  and  Techniques  by  M.  L. 
Abrams  and  H.  N.  Carr,  September  1971  and  (2)  NPTRL  SRR  73-23,  Description 
and  Preliminary  Training  Evaluation  of  an  Arc  Welding  Simulator,  by  M. 

L.  Abrams,  W.  R.  Safarjan,  and  R.  G.  Wells,  June  1973. 

Appreciation  is  expressed  to  LCDR  Ronald  W.  ^fyers.  Director,  Class 
"C"  Welding  School,  San  Diego,  and  to  CWO  3 Benjamin  F.  Burns,  Director, 
Phase  2 HT  Class  "A"  School,  San  Diego,  and  their  respective  staffs  for 
their  support  and  cooperation.  Special  acknowledgement  is  extended  to 
ETCS  Kenneth  L.  Davidson,  NPRDC,  and  personnel  from  the  Class  ”C"  Welding 
School  who  manufactured  the  prototype  simulators. 


J.  J.  CLARKIN 
Commanding  Officer 


SUMMARY 


Problem 


This  research  was  conducted  wi  determine  if  a physically  complex, 
continuous,  three-dimensional  psychomotor  skill  (such  as  silver 
brazing,  welding,  precision  soldering,  or  fusing  and  defusing 
ordnance)  could  be  acquired  more  efficiently  with  simulated- task, 
augmented  feedback  thu  with  the  feedback  normally  provided  by 
performing  the  task  itself.  The  specific  skill  selected  for  this 
study  was  arc  welding  because  it  is  representative  of  this  class 
of  skills  and,  in  addition,  it  represented  a skill  area  where 
Navy  training  problems  exist.  In  order  to  test  the  hypothesis, 
an  arc  welding  training  simulator  was  developed.  Consequently, 
this  study  also  evaluates  the  training  effectiveness  of  the  sim- 
ulator. 

Background  and  Requirements 


Research  into  the  effects  of  feedback  on  learning  has  been  exten- 
sive but  generally  focused  on  sumoary  feedback  in  verbal  learning. 

Most  research  on  psychomotor  skills  has  been  concerned  with  the 
effects  of  applying  augmented  feedback  on  physically  simpxa  tasks 
with  varying  degrees  of  cognlt'.ve  complexity  such  as  simple  posi- 
tional or  rotary-pursuit  tracking.  Such  research  has  not  dealt 
with  simulated- task,  augmented  feedback,  and  differing  conclusions 
relative  to  task-oriented,  augmented  feedback  have  been  reported. 

With  reference  to  complex  psychoootor  skills,  simulators  have  been 
used  primarily  to  consolidate  and  maintain  skill  rather  than  provide 
initial  skill  learning,  even  tuough  evidence  suggests  they  can 
be  successfully  employed  in  the  latter  case.  In  addition,  simulator 
research  has  generally  been  conducted  in  areas  where  (1)  high  costs 
limit  the  ixse  of  the  actual  equipment  in  training  and  (2)  highly  complex 
equipment  requires  Involved  training  programs. 


Approach 


To  provide  the  desired  simulated-task,  augmented  feedback,  a device 
was  built  consisting  of  (1)  a motor-driven  unit  representing  a 
welding  electrode  holder  (stinger)  and  electrode  (rod) , (2)  a moving 
target  representing  the  welding  path,  and  (3)  a box  housing  digital 
recorders  and  error  sensors  for  use  to  provide  Immediate  operator 
feedback.  The  welding  skill  monitored  by  the  sensors  were  length 
of  arc,  manipulation  of  the  molten  puddle  (tracking),  and  angle 
of  electrode. 


vli 


Thirty-six  Inexperienced  welding  trainees  were  selected  from  the 
enrollment  in  the  Hull  Technician  (HT)  "A"  School,  San  Diego, 
between  20  September  and  15  November  1973.  Eighteen  students  were 
assigned  to  an  experimental  group  and  alternated  their  time  equally 
between  the  simulator  and  the  weld  shop.  The  remaining  18  trainees 
were  assigned  to  the  control  group  and  received  conventional 
welding  practice  only.  After  about  12  days  of  training,  their 
performance,  by  visual  grading  of  the  vertical  and  o\erhead  test 
plates,  was  evaluated. 

Conclusions  and  Recomnendatlons 


1.  The  simulator  trainees  performed  significantly  better  than  the 

conventionally  trained  group.  Therefore,  It  appears  that:  (1) 

It  is  possible  to  acquire  a physically  complex  continuous  three- 
dimensional  psychomotor  skill  more  efficiently  with  simulated- 
task,  augmented  feedback  than  with  the  feedback  provided  by  per- 
forming the  task  Itself,  and  (2)  the  prototype  device  used  In  this 
study  can  be  utilized  effectively  to  train  arc  welders. 

2.  The  slmiilator  trainees  used  215  times  less  electrical  energy,  sub- 
stantially less  welding  materials,  and  spent  approximately  half 

as  much  time  In  the  weld  shop.  Thus,  It  appears  that  widespread 
use  of  the  device  would  provide  substantial  savings  and  Increased 
training  capabilities,  e.g. , the  nuaiber  of  welders  being  trained 
at  any  given  time  could  be  greatly  Increased  by  rotating  blocks 
of  trainees  between  simulator  and  weld  shop  practice.  The  device 
could  be  used:  (1)  to  assist  in  maintenance  of  skills  vaere  actual 

welding  practice  Is  not  possible,  such  as  during  submarine  patrols, 

(2)  to  select  men  with  the  greatest  potential  for  success  In  welding 
school,  and  (3)  as  a research  vehicle  to  study  other  physically  com- 
plex psychomotor  skills  (e.g.,  silver  brazing  or  precision  soldering). 

3.  The  prototype  simulator  should  be  refined  prior  to  recommending  wide- 
scale  usage  In  the  Fleet.  If  it  Is  to  be  used  aboard  ship.  It  should 
be  engineered  to  be  made  compatible  with  the  shipboard  environment 
(e.g.,  ruggedlzed  and  developed  In  accordance  vrlth  applicable  military 
specifications) . 
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ACQUISITION  OF  A PSYCECMOTOR  SKILL  USING 
SIMULATED-TASK,  AUGMENTED  FEEDBACK 
(Evaluation  of  a W6lding  Training  Simulator) 


Introduction 


Problem 

The  purpose  of  this  research  was  to  determine  If  a physically  complex, 
continuous,  three-dimensional  psychomotor  skill  (such  as  silver  brazing, 
welding,  precision  soldering,  or  fusing  and  defusing  ordnance)  could  be 
acquired  more  efficiently  with  simulated-task,  augmented  feedback  than 
with  the  feedback  normally  provided  by  nerforMng  the  task  Itself.  The 
specific  skill  selected  was  shielded  metal  arc  welding  because  It  Is  rep- 
resentative of  this  class  of  skills  and  is  an  area  where  Navy  training 
problems  exist.  To  test  the  hypothesis,  an  arc  welding  training  simulator 
was  developed.  Consequently,  this  study  also  evaluates  the  training  effec- 
tiveness of  the  simulator. 

Background 


Research  Into  the  effects  of  feedback  on  learning  has  been  extensive 
but  generally  focused  on  summary  feedback  In  verbal  learning  (e.g. , 

Hexley  & Thornton,  1972).  Most  research  on  psychomotor  skills  has  been 
concerned  with  the  effects  of  applying  augmented  feedback  on  physically 
simple  tasks  with  varying  degrees  of  cognitive  complexity.  Included  are 
such  skills  as  (1)  simple  positional  or  rotary-pursuit  tracking  (e.g., 
Bilodeau  and  Rosenqulst  (1964);  Blalves  (1970);  Blalwes  and  Regan  (1970); 
Briggs  (1962a  and  1962b);  Gordon  and  Gottlieb  (1967);  and  Williams  and 
Briggs  (1962)),  (2)  control-stick  manipulation  on  aircraft  simulators  (e.g., 
Briggs  and  Wiener  (1959);  Briggs  (1961);  Naylor,  Briggs,  and  Buckhout 
(1963);  and  Regan  (19591),  and  (3)  visual  tracking  on  gunnery  simulators 
(e.g.,  Goldstein  & Rlttenhouse  (1954)). 

In  this  research,  differing  findings  have  been  reported.  For  example. 

In  tracking  studies,  Bilodeau  and  Rosenqulst  (1964)  found  that  rotary- 
pursuit  performance  was  not  sensitive  to  supplementary  feedback;  Briggs 
(1962a)  found  that  It  was  best  to  use  augmented  feedback  when  the  subject 
was  In  error;  and  Karlin  (1965)  found  that  It  was  advantageous  to  use 
augmented  feedback  when  the  subject  was  on-target.  Blalwes  and  Regan  (1970) 
concluded  that:  (1)  It  was  difficult  to  generalize  psychological  finding, 

across  the  different  skilled  perceptual  motor  performance  tasks,  and  (2) 
there  Is  little  persuasive  evidence  demonstrating  relationships  between 
motor  tasks  characteristics  and  learning  variables. 


In  a continuous  task  like  welding,  augnented  feedback  may  also  be  termed 
cuing.  Briggs  (1962a)  defined  augmented  feedback  as  Information  provided 
to  the  human  operator  In  a skill  task  which  Is  supplementary  to  the  feedback 
Inherent  In  the  operation  of  the  task  Itself.  In  addition,  the  distinguish- 
ing characteristics  of  augmented  feedback  are  that  It  represents  an  evalua- 
tion of  operator  system  performance  and  occurs  with  minimal  lag.  Smode 
(1962)  defined  augmented  feedback  as  extra-performance  cues  or  Information 
to  the  operator  that  Indicate  when  his  performance  Is  within  specified 
accuracy  limits.  Annett  and  Clarkson  (1964)  and  Annett  & Paterson  (1966 
& 1967)  defined  cuing  as  the  provision  of  stimulus  Information  before  or 
during  a response  such  that  the  response  Is  made  more  effective  or  more 
likely  to  occur  than  would  be  the  case  without  such  Information.  In  the 
present  research,  the  training  simulator  provides  Immediate  feedback  when 
the  subject  exceeds  defined  parameters.  The  augmented  feedback  following 
a response  thus  becomes  stimulus  Information  for  the  continuing  response 
and  can  be  called  either  cuing  or  feedback. 

Simulator  research  conducted  thus  far  has  been  stimulated  by:  (1) 
the  rising  capital  and  eperating  costs  of  military  and  Industrial  equip- 
ment which  prohibit  Its  use  In  training,  and  (2)  the  Increasing  equipment 
complexity  which  demands  involved  training  programs  (Hammerton,  1966). 

In  complex  paychomotor  skill  training,  simulators  have  been  primarily  used 
to  consolidate  and  maintain  skills  rather  than  provide  Initial  skill 
learning.  For  example,  pilots  gain  their  skill  Initially  in  training 
aircraft,  but  maintain  this  skill  by  practicing  In  elmulamrs  (Hagne,  1962). 

Description  of  the  Task 

Shielded  metal  arc  welding  consists  of  (1)  joining  two  or  more  metals 
together  by  melting  them  with  an  electric  arc,  (2)  mixing  them  while  they 
are  in  a liquid  state,  and  (3)  allowing  them  to  return  to  a solid  state. 

The  arc  Is  generated  by  a consumable  metal  electrode,  which  becomes  part 
of  the  finished  weld.  To  perform  the  task,  the  welder  moves  In  different 
dimensions,  depending  on  the  welding  position.  For  example,  in  the  overhead 
position  shown  In  Figure  1,  the  welder  simultaneously  moves  as  follows: 

1.  He  rotates  his  wrist  axially,  causing  the  tip  of  the  electrode 
to  move  eidewaye — about  1/A  inch  (bet%»een  A artd  B In  Figure  1)  and  slightly 
forward — about  1/32  inch,  while  pulling  his  arm  toward  his  body  along  the 
weld  path.  This  movement  requires  distinct  pauses  at  the  end  of  each 
limit^. 


Other  equally  complex  motions  can  be  combined  to  produce  a weld.  The 
choice  of  the  fundamental  motion  described  was  Influenced  by  expert  welder 
opinion. 
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Figure  1.  Welder  movement  while  arc-welding  one  pass  and  consuming 
10  in.  of  electrode  (not  to  scale). 


2.  He  pushes  his  «rm  upward  to  maintain  the  correct  arc  length  as 
the  electrode  melts  away  (from  C to  E in  Figure  1). 

i.  He  holds  his  hands  ccn&tant»  while  continuously  adjusting  his 
arms  to  maintain  a fixed  rod  angle  with  respect  to  the  weld  surface  (not 
shown) . 

In  normal  Navy  training  after  the  trainee  is  given  a demonstration  of 
the  procedure,  he  retires  to  a booth  and  practices  by  rtuinlng  weld  passes 
that  take  about  1 minute  each.  After  the  completion  of  each  pass,  it  can  be 
evaluated  as  good  or  bad.  As  can  be  expected,  the  trainee's  initial  veld 
passes  are  generally  unacceptable,  and  it  is  usually  impossible  to  deter- 
mine what  caused  the  unacceptable  condition.  Initially,  the  trainee  is 
not  able  to  process  the  exteroceptive  and  proprioceptive  feedback  cues 
Inherent  in  the  task.  Also,  the  nature  of  the  task  precludes  the  instruc- 
tor from  observing  the  trainee's  performance  as  he  welds.  Thus,  the 
trainee  has  no  way  of  knowing  which  of  the  many  defined  parameters  he  is 
exceeding  as  he  learns  to  weld.  Appendix  A is  an  analysis  of  welding  skill 
development . 


The  Welding  Simulator 
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Configuration 

Structurally,  the  simulator  resembles  actual  shielded  metal  arc  (SMA) 
welding  equipment  and  can  be  used  in  any  welding  position.  As  Illustrated 
in  Figure  2,  it  consists  of  three  major  units:  (1)  the  stinger,  a motor- 

driven  device  similar  in  form,  weight,  and  purpose  to  an  actual  electrode 
holder  and  the  consumable  electrode  (rod);  (2)  the  track  unit,  a motor- 
driven  target  that  simulates  the  welding  path;  and  (3)  the  control  unit, 
a unit  that  houses  error  sensors,  digital  recorders,  and  associated 
electronics  that  provide  immediate  operator  feedback.  The  welding  func- 
tions monitored  by  these  sensors  are  length  of  arc,  manipulation  of  the 
molten  puddle  (weave),  and  angle  of  electrode. 

The  trainee  holds  and  manipulates  the  simulator  stinger  unit  in  the 
same  way  that  he  would  handle  an  actual  stinger.  However,  his  efforts  do 
not  result  in  a wexJ  but  in  feedback  cues  that  inform  him  of  his  progress 
in  acquiring  one  or  a combination  of  the  three  basic  welding  behaviors. 


2 

This  discussion  is  extracted  from  Abrams,  Safarjan,  & Wells,  1973. 
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Figure  2.  Welding  slamlator  configuration. 


Feedback  Cues 

As  noted,  a major  obstacle  to  acquiring  the  arc  welding  skill  Is  the 
trainee's  Inability  to  know  which  of  the  many  parameters  he  is  exceeding 
and  when.  With  the  simulator.  It  was  hypothesized  that  this  obstacle 
would  be  minimized  by  cond>lnlng  augmented  feedback  on  the  basic  conq>onents 
of  the  mldlng  task  with  the  cues  Inherent  In  welding.  This  feedback  Is 
achieved  In  the  following  manner: 

1.  Arc  Length,  To  provide  proper  proprioceptive  cues,  the  electrode 
recedes  at  a rate  equivalent  to  that  at  which  an  electrode  melts  under 
nonanl  welding  conditions.  If  the  trainee  falls  to  maintain  the  proper 
arc  length  (l/16-to-3/16  In.),  augmented  feedback  Is  provided  as  follows: 
(I)  the  electrode  stops  receding,  (2)  the  electicalcally  generated 
"crackling,  hissing"  sound  which  resembles  that  of  a burning  electrode 
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terminates,  and  (3)  the  light  that  corresponds  to  arc  Illumination  ex- 
tinguishes. These  go-no-go  qualities  simulate  the  natural  welding  en- 
vironment— that  is,  an  excessively  short  arc  results  in  the  electrode 
becoming  stuck  in  the  puddle  and  an  excessively  long  arc  results  in 
breaking  of  the  arc. 

2.  Weave.  To  develop  the  proprioceptive  cues  resulting  from  the 
side-to-slde  welding  motion  (Including  pauses  at  each  side) , the  track 
duplicates  the  precise  dimensions  and  speeds  required  to  produce  a 
quality  weld  (see  Appendix  A).  The  trainee  alms  the  stinger-electrode 
at  the  track,  and  any  deviation  from  the  slde-to-side  movement  results 

in  an  augmented  feedback  tone  of  about  1000  Hz.  While  the  trainee  follows 
these  movements  (rather  than  initiate  them  as  he  would  do  in  an  actual 
welding  situation) , simulation  permits  repeated  exposure  to  the  proprio- 
ceptive cues  that  normally  would  be  received  only  after  the  trainee  had 
learned  to  weld.  Much  reinforcement  of  incorrect  behavior  is  thus  elim- 
inated, and  the  trainee  can  spend  his  time  in  the  correct  stimulus  con- 
dition. 

3.  Angle  of  Electrode.  As  in  weave,  the  proper  stimulus  condition 
for  angle  of  electrode  is  present  only  after  the  trainee  has  developed 
his  welding  skill  through  a laborious  trial-and-error  process.  This  angle 
is  defined  as  that  between  the  electrode  and  the  item  welded  relative 

to  the  direction  of  the  weld.  With  the  simulator,  when  the  trainee  fails 
tc  keep  the  angle  of  electrode  within  the  allowable  tolerance  of  5-to-15 
degrees,  a tone  of  about  3000  Hz  is  presented  until  the  angle  is  corrected. 

The  sensitivity  of  tha  feedback  sensors  can  be  adjusted  for  each  of 
the  three  welding  skill  components.  Ulus,  it  is  possible  to  shape  behavior 
by  allowing  greater  tolerance  during  the  initial  acquisition  phase  than 
during  the  later  stages  of  skill  develonment..  Feedback  can  also  be  used 
selectively  by  providing  cues  exclusive  to  one  welding  component,  and  then 
integrating  them  with  cues  provided  for  the  second  and  third  components. 


Ifethod 


Subjects 

The  subjects  (^s)  were  Hull  Maintenance  Technician  (HT)  Fireman  and 
Fireman  Apprentice  trainees  enrolled  in  the  HT  "A"  School,  San  Diego, 
between  20  September  and  15  November  1973.  Over  this  period,  36  inexperi- 
enced welding  trainees  were  randomly  selected  to  partlclapLe  in  the  exper- 
iment. These  ^s  were  given  a pre-exp i,rlmental  orientation  and  two  5-minute 
pretest  trials  on  the  apparatus.  Based  on  the  pretrial  scores,  ^s  were 
matched  and  assigned  to  either  the  experimental  (E)  or  control  (C)  group 
for  an  interval  of  approximately  12  days. 


MM 


Apparaf-is 

Both  E and  C groups  received  identical  weld  shop  instruction  in  the 
arc-welding  shop  of  the  HT  "A"  .hool»  used  identical  welding  machines 
and  associated  materials,  and  performed  the  same  weld  projects.  Addi- 
tionally, the  E group  practiced  on  the  simulators  in  4:::4x8  ft.  booths 
similar  in  size  and  configuration  to  the  weld-shop  booths  (see  Figure  3) . 
Each  booth  had  an  adJ'jrtable  fixture  for  hunting  the  track  unit  to 
correspond  with  the  var:f  welding  positions  the  trainee  practiced  in 
the  arc  shop.  The  control  unit  and  a timer  to  measura  trial  length  were 
positioned  outside  the  booth  for  ease  in  recording  data. 

The  feedback  sensor  circuits  were  adjusted  to  provide  feedback  and 
record  errors  wheu  certain  parameters  were,  exceeded.  Feedback  delays 
for  both  weave  and  angle  error  sensors  were  set  at  0.5  second,  which  meant 
that  the  trainee  could  be  off  target,  or  exceed  rod  angle  limits,  for  up 
to  0.5  second  before  the  tone  would  sound.  There  was  no  temporal  delay 
for  arc  length  error. 


Criterion  Test 


It  was  desired  that  the  criterion  test  should  measure  a unit  of  learning 
that  Incorporated  the  skills  required  in  quality  welding  and  yet  had  an 
objective  that  could  be  attained  by  an  inexperienced  trainee  in  a short 
time.  The  70-hour  learning  unit  on  overhead  and  V-butt  welding  from  the 
Class  "C"  Welding  School's  Plate  Course  came  closest  to  meeting  these 
specifications. 

In  this  unit,  the  trainee  learns  how  to  arc  weld,  with  the  E-6011  elec- 
trode, two  5"x6"x3/8"  mild  steel  plates  butted  together  with  a backing 
strip  (see  Figure  4)  in  both  the  overhead  ana  vertical  positions. 

After  practicing  each  learning  task  for  approximately  28  hours,  the 
trainee  takes  the  final  criterion  test  which  consr'sts  of  welding  a test 
plate  in  about  7 hours. 

Although  this  70-hour  learning  unit  was  considerably  more  difficult 
than  ongoing  "A"  School  units,  the  "A*'  School  agreed  to  add  It  to  its 
curriculum  for  purposes  of  the  evaluation.  However,  only  50  hours  were 
allocated  for  the  unit.  Upon  completion  of  the  project,  three  Instructors 
visually  graded  the  test  projects  independently,  using  standard  criteria 
(l.e.,  from  a maximum  possible  score  of  100,  points  were  deducted  for 
undercut,  cracks.  Irregular  bead  appearance,  lack  cf  fusion,  and  excessive 
build-up) . This  was  done  because  the  "A"  School  did  not  have  a radiographic 
capability  nor  were  grinders  available  to  properly  prepare  the  test  plates 
for  radiographic  testing.  Because  there  was  instructor  agreement  in  terms 
of  ranking  the  projects,  the  final  score  was  obtained  by  averaging  *:he 
grades  of  the  three  instructors. 
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Figure  A.  Mild  steel  plates  butted  together. 


Procedure 


Initially,  all  were  given  a pre-experlmental  orientation  and  two 
5-iolnute  pretrials  on  the  simulator.  The  £s  then  reported  to  the  arc  shop 
where  basic  arc-welding  procedures  and  shop  safety  were  described.  At 
this  point,  the  £ was  permitted  to  progress  through  the  program  at  his 
own  rate,  providing  he  did  not  spend  more  than  25  hours  each  on  overhead 
and  vertical  welding.  All  ^s  remained  In  the  arc  shop  for  the  initial 
weld  learning  task,  which  Involved  striking  and  holding  an  arc  and  running 
beads  In  the  flat  position.  The  C and  E groups  continued  on  to  overhead 
and  vertical  V-butt  welding.  The  C group  trainees  spent  their  time  In 
the  arc  welding  shop  whereas  the  E group  alternated  hours  between  the  arc 
shop  and  simulator  laboratory. 

In  the  simulator  laboratory,  the  1-hour  sessions  consisted  of  three 
trials.  To  assure  that  each  trainee  received  equal  simulator  practice, 
trial  time  was  measured  In  real  arc  time  (l.e.,  the  total  time  that  a proper 
arc  length  was  maintained) . Trial  and  Intertrlal  lengths  were  9 and  3 
minutes,  respectively.  Trainees  were  given  about  a 10-mlnute  rest  after 
the  third  trial.  Simulator  scores  on  arc  length,  angle,  and  weave  were 
recorded  from  the  digital  counters  at  the  end  of  each  trial,  thus  allowing 
a record  to  be  kept  '^f  the  trainees'  progress.  Because  of  variations  In 
the  operating  characteristics  of  the  prototype  simulators,  each  subject 
was  assigned  his  own  device  for  the  duration  of  the  experiment.  The  per- 
centage of  Improvement  In  each  of  the  variables  of  simulator  performance 
for  each  position  was  recorded  for  comparison  with  the  respective  test 
plate  grades  from  the  welding  shop.  This  was  computed  by  the  percent 
gain  of  possible  gain  method  No.  1 (McGraw,  1955) . 

Upon  completion  of  each  project  In  the  weld  shop,  the  test  plate 
was  sent  to  the  simulator  laboratory  for  coding  and  storage  until  the 
experiment  was  completed.  At  that  time,  the  Instructors  graded  all  test 
plates,  which  assured  that  a blind  grading  procedure  was  followed. 


For  Mch  trainee,  recorda  were  kept  of  total  training  time  and  how 
that  time  waa  apent.  In  the  wold  shop,  time  was  recorded  for  (1)  welding 
practice  (burning  rod  tiae^,  (2)  performance  of  the  requisite  ancillary 
behaviors  (e.g. , setting  up,  quenching,  chipping,  and  wire  brushing),  and 
(3)  breaks  (both  schedtiled  and  unscheduled).  In  the  simulator  laboratory, 
time  was  recorded  for  (1)  simulator  practice,  (2)  performance  of  the  req- 
uisite ancillary  behaviors  (e.g.,  resetting  rod  and  track.  Incorrect  arc 
time,  recording  data,  and  adjusting  equipment),  and  (3)  breaks  (scheduled 
breaks,  Intertrlal  rest,  and  unscheduled  Interruptions).  Data  on  weld 
practice  and  all  slanilator  behaviors  were  obtained  by  real-time  measure- 
ments using  timers  attached  to  each  machine.  The  remaining  data  were 
obtained  by  observational  sampling  of  behavior  throu^out  the  training 
period. 


Results 


Criterion  scores  were  evaluated  by  an  analysis  of  variance,  as  shown 
In  Appendix  B.  The  mean  scores  were  sl^lflcantly  higher  lor  the  E group 
They  were  86.3  and  77. A,  respectively,  for  the  E and  C groups  on  the 
overhead  teat  plates,  and  90.3  and  80.1  on  the  vertical  test  plates.  The 
higher  vertical  scores  for  both  groups  reflect  positive  transfer  from  the 
overhead  training,  which  preceded  the  vertical  practice. 

Correlations  were  computed  between  overhead  test  plate  grades  and 
simulator  measurements  of  percentage  of  Improvement  for  arc,  track,  and 
combined  arc-track.  The  correlations  were  .73  for  arc,  .62  for  track, 
and  .79  for  coabiued  arc  track. 

Similar  correlations  could  not  be  run  for  the  vertical  project  because 
^8  finished  this  project  prior  to  the  collection  of  sufficient  simulator 
progress  data.  This  was  a result  of  Insufficient  control  over  ongoing 
weld-shop  procedures.  In  addition,  angle  error  data  were  not  computed 
since  the  angle  sensor  circuitry  was  not  completely  operational  until 
the  experiment  was  partially  completed. 

Table  1 shows  the  mean  training  time  for  both  groups  on  the  two  projects 
used  as  criteria  (overhead  and  vertical  V-butt  welding).  Table  2 Indicates 
mean  total  training  time  for  these  projects  and  Identifies  mean  time  devoted 
to  the  various  behaviors.  The  tables  show  that  mean  total  training  time 
for  both  groups  was  essentially  the  same. 
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TABLE  1 

Average  Aaount  of  Tine  Spent  on  Each 
Project  In  the  Unit  of  Inatructicn 


^ i>roup 

E Group 

Projects 

X Hours 

X Hours 

VERTICAL 


TABLE  2 

Distribution  of  Training  Time  for  Overhead  and  Vertical  Projects 


Behavior 


SIMULATOR  LAB: 

Practice  on 
Siaulitor 

Ancillary  Behaviors 
Breaks 


TOTAL  TIME  - SIMILATOR 


WELD  SHOP: 

Practice  Welding 
Ancillary  Behaviors 
Breaks 


TOTAL  TIME  - WELD  SHOP 


TOTAL  TIME  - SIMULATOR  LAB 
and 

WELD  SHOP 


E Group  1 

X Hours 

X of  Total 
Time 

10.6 

29.1 

2.3 

6.3 

4.8 

13.2 

17.7 

48.6 

4.0 

11.0 

11.8 

32.4 

2.9 

8.0 

18.7 

51.4 

36.4 

C Grou 


X Hours  % of  Total 
Time 


Discussion 


The  E group  perforated  significantly  better  than  the  C group  on  both 
criterion  tests.  Thus,  there  Is  strong  evidence  for  positive  transfer 
froa  the  simulated  task  to  the  actual  task.  The  simulator  apparently 
provides  more  efficient  practice  on  the  complex  behaviors  Involved  In 
perforating  the  task  (l.e.,  rod  feeding,  rod  angle,  puddle  manipulation, 
and  their  Integration)  than  does  practice  on  the  task  Itself.  This  Is 
a result  of  providing  aug^nted  feedback  not  available  when  practicing 
the  task.  In  addition,  the  simulated  task  facilitates  the  Integration 
of  the  various  coaiplex  behaviors  In  welding  by  providing  feedback  Ir.  three 
different  dimensions  not  available  In  performing  that  task.  Table  2 bhows 
that  the  E group  practiced  a mean  of  14.6  hours  on  these  behaviors  (l.e., 
10.6  hours  simulator  practice  plus  4.0  hours  weld  practice)  compared  to 
a mean  of  6.0  hours  for  the  C group. 

A difference  In  practice  time,  which  favored  the  E group,  also  occurred 
In  the  weld  shop.  This  probably  resulted  from  the.  positive  relationship 
existing  between  welding  proficiency  and  welding  practice  time,  l.e.,  the 
less  proficiency  the  trainee  has,  the  more  mistakes  he  makes,  which,  in 
turn,  results  In  Increases  In  ancillary  and  nonproductive  behaviors  (Abrams 
and  Carr,  1971).  Additional  evidence  for  positive  transfer  from  the  simu- 
lated task  to  the  real  task  comes  from  the  high  correlations  between  the 
percentage  of  lmprovemer>t  In  simulator  performance  and  overhead  test  plate 
grades. 

Besides  the  angle  sensor  circuitry  problems  previously  Identified, 
the  prototype  device  experienced  certain  problems  requiring  minor  modifi- 
cations. Althou^  these  difficulties  did  not  appreciably  affect  the  quality 
and  reliability  of  the  data.  Increased  reliability  must  be  attained  for 
this  device  to  be  used  on  a wide  scale. 

The  potential  advantages  of  the  simulator  may  extend  beyond  Increased 
welder  performance.  A substantial  reduction  In  training  time  should  be 
obtained  In  longer  advanced  welding  courses  (e.g.,  "C"  School  courses  run 
from  10  to  24  weeks).  However,  even  If  the  potential  time  savings  are 
Ignored,  rotation  of  personnel  between  simulators  and  welding  machines 
should  provide  for  reductions  In  material  costs  (e.g.  welding  machines, 
electrodes,  mecals)  and  Increased  training  capabilities. 

The  use  of  the  device  provides  substantial  energy  savings.  A welding 
machine  consumes  approximately  5,175  watts  cotapared  to  approximately  24W 
for  the  simulator.  Thus,  one  welding  machine  uses  215  times  the  energy 
used  by  one  simulator,  or,  as  much  power  as  215  simulators.  The  C group 
trainees  consumed  an  average  of  31,050  watt  hours  (6  hours  at  3,175W) 
compared  to  an  average  of  20,954  watt  hours  (4  hours  at  5,175W  and  10.6 
hours  at  24W)  for  the  E group  trainees.  The  average  difference  in  corn- 
sumption  was  10,096  watt  hours.  If  all  120  trainees  (usual  on-board 


coimt  at  the  HI  "A"  School)  alternated  between  a slnulator  and  welding 
■achlne,  a aaTings  of  1,211,520  watt  hours  would  be  realized  each  2-veek 
Interval,  or  30,288,000  watt  hours  per  year  (50  weeks  per  year). 


Conclusions  and  Recoanendatlons 


Froa  the  results  of  this  study.  It  Is  concluded  that  (1)  a physically 
cos|>lex,  continuous,  three-dimensional  psychomotor  skill  can  be  acquired 
more  efficiently  with  simulated-task  augmented  feedback  than  with  the 
feedback  provided  by  performing  the  task  Itself,  and  (2)  the  prototype 
device  developed  can  be  utilized  effectively  tc  train  arc  welders. 

The  simulator  trainees  not  only  performed  better  but  used  215  times 
less  energy,  substantially  less  welding  material,  and  spent  approximately 
half  as  much  time  In  the  welding  shop  as  their  counterparts.  Thus,  If 
the  device  were  used  on  a large  scale,  welding  schools  would  realize  sub- 
stantial savings  In  energy  consumption,  material  costs,  and  greatly  in- 
creased training  capabilities  ( l.e.,  the  nuid>er  of  students  could  possibly 
be  doubled  by  rotating  blocks  of  trainees  between  simulator  and  weld-shop 
practice).  However,  prior  to  recomnendlng  large-scale  purchase  of  the 
present  device.  It  should  be  refined.  Also,  If  It  Is  to  be  used  aboard 
ship.  It  should  be  engineered  to  be  compatible  with  the  shipboard  environ- 
ment (e.g. , mggedlzed  and  built  In  accordance  with  applicable  military 
specifications) . 

The  device  can  be  used  to  maintain  welding  skill  In  circumstances  where 
actual  welding  practice  Is  not  possible  - for  example,  aboard  submarines 
where  requallflcatlon  failure  rates  for  machinist  mate  welders  are  aboun 
60  percent  (Abrams,  Bishop,  LeRoy,  1969).  The  simulator  may  also  function 
as  a quantitative  measuring  device  to  select  the  most  promising  trainees 
for  welding  school. 

Further  research  usiug  the  device  as  a vehicle  to  study  the  use  of 
simulated-task,  augmented  feedback  to  acquire  physically  complex,  continu- 
ous, three-dimensional  psychomotor  skills  should  be  expanded  to  Include 
such  skills  as  silver  brazing,  precision  soldering,  or  fusing  and  defusing 
ordnance.  Variables  such  as  trial  length,  session  length,  mass  versus 
distributed  practice,  ratio  of  use  of  the  simulated-task  device  to  tb'. 
task  Itself,  and  shaping  and  fading  should  be  Investigated. 
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APPENDIX  A 

Analysis  of  Welding  Skill  Development^ 


This  analysis  Is  based  on  trainee  observation.  Instructor  experience, 
and  related  research  on  skill  learning.  Welding  skill  development  essen- 
tially was  found  to  be  a learning  process  In  which  the  desired  skills  must 
be  Incorporated  Into  the  behavioral  pattt^rns  of  the  trainee  despite  a 
complex  stimulus  situation.  Interference  from  mistakes  and  old  habits, 
and  poor  feedback.  The  welding  trainee  Is  first  shown  by  the  Instructor 
what  good  welding  looks  like.  He  must  then,  through  practice.  Incorporate 
the  demonstrated  behavior  Into  his  own  behavioral  patterns.  In  other  words, 
he  must  learn  to  make  the  correct  movement  to  a complex  stimulus  situation 
which  Includes  aspects  of  the  welding  process  and  also  the  trainee's  own 
kinesthetic  feedback.  Knowledge  of  results  Is  provided  by  the  welding 
process.  Using  the  slde-to-slde  welding  technique  as  an  example,  the  welder 
makes  a zig-zag  movement  In  which  he  pauses  for  a certain  period  at  the 
sides  of  the  movement.  The  length  of  the  pause  Is  determined  by  the  appear- 
ance of  the  molten  puddle.  If  he  pauses  too  long,  the  molten  puddle  will 
become  too  large.  If  he  falls  to  pause,  an  error  known  as  undercut  will 
occur.  The  experienced  welder  makes  this  zig-zag  movement  in  a rhythmic 
motion  that  shows  he  Is  also  using  kinesthetic  feedback  to  Integrate  and 
anticipate  the  required  movements. 

Further  analysis  of  the  welding  skill  will  be  specifically  directed 
to  its  main  components:  (1)  incorporation,  (2)  interference,  (3)  dis- 

crimination of  the  exteroceptive  cue  situation , (4)  feedback,  (5)  the 
circular  feedback  loop  of  the  welding  process,  (6)  positioning,  and  (7) 
wrist  action  in  the  slde-to-slde  motion. 

1.  Incorporation.  On  the  first  day  in  the  laboratory,  the  instructor 
demonstrated  to  an  Inexperienced  trainee  how  to  strike  and  maintain  an 
arc.  The  trainee  then  attempted  to  do  it.  He  fed-in  the  electrode  In 
steps.  After  practice  the  trainee  began  to  feed- in  the  electrode  smoothly. 

The  demonstration  deals  with  the  exteroceptive  stimuli  or  cues  of 
the  welding  process  that  the  trainee  must  respond  to  and  the  results  he 
is  trying  to  achieve.  An  instructor  cannot  give  the  trainee  the  feel 
of  running  the  electrode.  He  can  only  show  the  trainee  what  a good  welding 
job  looks  like  and  provide  him  with  a general  idea  of  what  movements  he 
must  make.  The  trainee  then  sets  out  to  do  what  he  has  been  shown.  In 
his  first  attempts,  his  reaction  must  bt.  entirely  dependent  on  the  extero- 
ceptive cues  from  the  welding  process.  Hj s movements,  however,  provide 
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proprioceptive  cues  which,  «a  he  contlnuee  to  practice,  can  be  used  to 
anticipate  what  suat  be  dona  next  and  to  Intejrate  his  nnveiaents  Into  a 
continuous  pattern.  In  the  axsaiple  above,  proprioceptive  feedback  appar- 
ently enabled  the  trainee  to  aalntaln  a steady  feed-ln  rate  after  practice. 

2.  Interference.  Even  after  receiving  considerable  Individual  attention 
f (m  the  Instructors,  some  trainees  rapidly  revert  back  to  their  old  bad 
habits.  In  an  exanple  of  thla  froa  the  present  experiment,  one  trainee,  who 
was  able  to  feed-ln  the  electrode  smoothly,  nevertheless,  required  repeated 
help  before  he  started  to  use  the  proper  slde-to-slde  technique.  An 
explanation  may  be  that  the  trainee's  own  imperfect  practice  causes  Inter- 
ference. That  Is,  the  trainee  sets  out  to  do  what  the  Instructor  has 
shown  him,  but  he  cannot  do  It.  His  own  failure  provides  interference 
that  causes  him  to  forget  the  Instructor's  demonbtratlon.  Because  of 
Interference  from  his  mistakes  and  old  habits,  there  Is  a good  chance  that 
the  trainee  will  become  confused  rather  than  succeed, In  incorporating  the 
demonstrated  behavior.  Of  course,  the  trainee  may  have  failed  to  attend 
to  Important  aspects  of  the  Instructor's  demonstration.  In  this  case, 
or  the  case  of  unsuccessful  Incorporation,  the  trainee's  progress  is  im- 
peded. 

■}.  Discrimination  of  the  exteroceptive  cue  situation.  The  discriminations 
the  welding  trainee  must  learn  to  make  are  complex.  For  instance,  he 
is  Instructed  to  maintain  an  1/8-lnr.h  arc  length  with  the  6011  electrode, 
which  requires  that  he  learn  to  discriminate  cue  situations  Indicating 
correct/incorrect  arc  length.  There  are  many  cues  which  Indicate  whether 
or  not  the  correct  arc  length  Is  being  nmlntained.  In  some  welding  posi- 
tions, the  arc  length  '■.an  be  viewed  directly;  however,  this  procedure  Is 
not  reesmmeuded  because  good  welding  required  constant  reference  to  the 
puddle.  Other  cues,  considerably  more  complex  for  the  trainee  to  dis- 
criminate, Include  the  amount  of  spattering,  brightness  of  the  puddle, 
and  sound  of  the  arc. 

4.  Feedback.  The  trainee  Is  provided  with  three  aource.^  of  feedback  or 
knowledge  of  results.  One  source  Is  from  the  welding  process  Itself. 

The  previous  uectlon  gives  some  Idea  of  the  complexity  of  the  Information 
the  welding  process  cue  situation  provides.  For  the  inexperienced  trainee, 
this  Information  certainly  does  not  provide  clear  feedback  on  his  actions. 
Another  source  of  feedback  Is  from  the  testing  or  inspection  of  the  com- 
pleted weld.  The  problem  here  is  In  the  delay  of  feedback  (hours  or  even 
days).  It  is,  therefore,  doubtful  that  the  latter  feedback  is  Important 
in  the  learning  process  other  than  as  a motivator  to  get  the  trainee  tc 
try  to  find  out  what  he  did  wrong.  The  third  source  of  feedback  comes 
from  the  Instructor  observing  the  trainee  weld.  Providing  such  feedback 
required  a large  amount  of  instructor  time  and  effort.  Also,  observing 
the  trainee  In  some  welding  situations  Is  quite  difficult. 
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5.  The  circular  feedback  loop  of  the  weJ.dlng  process.  A major  source  of 
the  difficulty  In  learning  welding  may  be  in  the  circular  nature  of  the 
task.  The  aovementa  required  depend  on  the  cue  situation,  but  the  cue 
situation  is  a result  of  the  movements  the  trainee  just  made  - that  is, 
acquiring  welding  skill  involves  learning  to  make  the  right  physical 
movement  to  a particular  cue  situation.  The  cue  situation  consists  of 
exteroceptive  feedback  from  aspects  of  the  welding  process  and  proprio- 
ceptive feedback,  both  of  which  are  a result  of  previous  movements  by  the 
trainee.  If  the  trainee's  inability  produces  a cue  situation  grossly 
different  from  the  desired,  he  cannot  be  learning  the  stimulus-response 
relationships  of  good  welding. 

6.  Positioning.  Many  of  the  trainees  would  do  a good  job  on  the  first 
half  of  their  pass  and  then  become  unsteady.  Apparently  a concept  the 
trainee  had  to  learn  was  to  position  and  support  himself  so  that  he  could 
use  the  ^ntire  electrode  without  having  to  make  an  inappropriate  postural 
adjustment.  This  seemed  to  be  more  than  a trivial  thing  to  learn,  and 
apparently  Involved  considerable  experimentation  on  the  part  of  the  train- 
ees. Another  specific  point  was  that  when  the  beginning  trainee  welds  in 
the  vertical  position,  he  tends  to  raise  only  his  forearm  as  he  continues 
up  the  plate.  This  throws  the  angle  of  the  electrode  off.  The  trainee 
must  be  taught  to  raise  his  whole  arm,  or  arm  and  body,  to  prevent  changing 
the  angle  of  the  electroue. 

7.  Wrist  action  in  the  side-to-side  motion.  In  using  the  side-to-side 
motion,  the  beginning  trainee  has  a tendency  to  use  both  arms  or  the  whole 
welding  arm  to  make  the  side-to-side  motion.  This  does  not  work,  because 
the  proper  side-to-side  motion  Involves  going  rapidly  across  the  center 

of  the  puddle  and  holding  the  i ides.  If  the  whole  arm  is  used,  too  much 
time  is  spent  in  the  center  of  the  puddle,  which  leads  to  excessive  buildup. 
The  side-to-side  motion  must  be  made  by  using  the  wrist,  and  the  trainee 
may  require  considerable  help  in  learning  this  technique. 
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APPENDIX  B 


Analysis  of  Variance  Conparlng  Overhead  Test 
Plate  Scores  of  the  Experimental  and  Control  Groups 


Source 

F 

A 

1 

640.9 

6.25* 

S/A 

34 

102.4 

TOTAL 

35 

* 2 < .05 

Analysis  of 
Plate  Scores  of 

Variance  Comparing  Vertical  Test 
the  Experimental  and  Control  Groups 

Source 

df 

IB 

F 

A 

1 

950.7 

14.8* 

S/A 

34 

67.49 

TOTAL 

35 

*£  < .01 
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